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ABSTRACT 


In the early 1980s, two F-16 airplanes were modified to extend the fuselage length and incorporate a 
large area delta wing planform. These two airplanes, designated the F-16XL, were designed by the 
General Dynamics Corporation (now Lockheed Martin Tactical Aircraft Systems) (Fort Worth, Texas) 
and were prototypes for a derivative fighter evaluation program conducted by the United States Air 
Force. Although the concept was never put into production, the F-16XL prototypes provided a unique 
planform for testing concepts in support of future high-speed supersonic transport aircraft. To extend the 
capabilities of this testbed vehicle the F-16XL ship 1 aircraft was upgraded with a digital flight control 
system. The added flexibility of a digital flight control system increases the versatility of this airplane as 
a testbed for aerodynamic research and investigation of advanced technologies. This report presents the 
handling qualities flight test results covering the envelope expansion of the F-16XL with the digital flight 
control system. 


NOMENCLATURE 


CHR 

Cooper-Harper rating 

dep 

pitch stick input 

DFLCS 

digital flight control system 

FFT 

fast Fourier transform 

8 

acceleration of gravity 

HUD 

head-up display 

K 

thousands of feet, altitude 

KCAS 

knots calibrated airspeed 

LEF 

leading edge flaps 

LOES 

lower order equivalent system 


dimensional lift curve slope, sec 

MIL-STD 

military standard 

N z 

normal load, g 

PIO 

pilot induced oscillation 

P s 

specific excess power, ft/sec 

q 

pitch rate, deg/sec 

q 

dynamic pressure, psi 

s 

slope, dB 

VCAS 

calibrated airspeed, kn 

V true 

true velocity, ft/sec 

a 

angle of attack, deg 


C, e LOES equivalent damping 

x estimated time delay, sec, bandwidth criterion 

x ff effective time delay, sec 

x ct| LOES equivalent time delay, sec 

x f roll mode time constant, sec 

4> c Ralph-Smith phase angle at critical frequency, deg 

(b 9 phase value at twice the phase crossover frequency, rad/sec 

ztu 180 

tO bo bandwidth frequency from gain curve, rad/sec, bandwidth criterion 

CO b p bandwidth frequency from phase curve, rad/sec, bandwidth criterion 

co c Ralph-Smith critical frequency, rad/sec 

co e LOES equivalent frequency, rad/sec 

co 180 magnitude at phase crossover frequency, dB 

2 co j 80 twice the phase crossover frequency, dB 


INTRODUCTION 

The F-16XL ship 1 aircraft was flown with a digital flight control system (DFLCS) for the first time 
in December 1997. The F-16XL has its origins in the early 1980s when the General Dynamics 
Corporation (Ft. Worth, Texas) (now Lockheed Martin Tactical Aircraft Systems (LMTAS)) developed a 
prototype concept for a derivative fighter evaluation program conducted by the Air Force between 1982 
and 1985. The concept was to modify the existing F-16 design to extend the fuselage length and 
incorporate a large area delta wing planform. The resulting F-16XL had a greater range because of 
increased fuel capacity in the wing tanks, and a larger load capability because of increased wing area. 
Two airplanes were built and extensively flight-tested (ref. 1). 

The F-16XL concept was never put into production, but the two prototypes provided a unique 
planform for testing technological concepts in support of future high speed aircraft, such as supersonic 
commercial transports. A passive wing glove was utilized to investigate the ability to achieve natural 
laminar flow through careful contouring of the wing surface (ref. 2). The feasibility of active laminar 
flow control using an internal suction system built into the wing (ref. 2) was investigated. Further support 
for future supersonic transport aircraft was provided by a sonic boom research project that used the 
F-16XL for airborne measurements of the propagation of an SR-71 sonic shock wave (ref. 3). 

To extend the capabilities of this testbed vehicle F-16XL ship 1 was upgraded with a DFLCS. The 
DFLCS was designed by LMTAS and used hardware developed for the fleet F-16 digital upgrade (block 40). 

The DFLCS flight envelope clearance program began in December 1997 and ended in March 1998. 
A total of ten flights were flown to collect maneuvering performance and handling qualities data. 
Conventional handling qualities analysis techniques were applied to the F-16XL flight data, and where 
possible results were compared with qualitative pilot assessments of the airplane handling qualities. This 
report summarizes the results obtained during these ten flights. 
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AIRPLANE DESCRIPTION 


The F-16XL ship 1 aircraft is a modified F-16A and is shown in figure 1. This high performance, 
single seat airplane features a highly swept delta wing designed for sustained supersonic flight. Vehicle 
control is achieved by elevons and ailerons at the trailing edge of the wing, and a rudder mounted on the 
trailing edge of the single vertical stabilizer. Outboard leading edge flaps (LEF) are used as secondary 
control surfaces and are automatically scheduled with angle of attack (a) and Mach number. Figure 2 
contains a summary of the physical properties of the airplane (ref. 4). 



EC97-44354-1 

Figure 1. F-16XL ship 1 takes off for the first flight using the digital flight control system. 


The F-16XL can operate at a Mach number as high as 2.0, an altitude as high as 60,000 ft, and under 
a load as high as 9.0 g. During this program, however, the airplane was operated under a limit of 
Mach 1.6 with a load limit of 7.2 g or Mach 1.8 with a restricted load limit of 3.0 g. 
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Aileron 
Area: 29.4 ft 2 




Figure 2. F-16XL planview with key physical and geometric properties. 


Longitudinal and lateral pilot inputs to the control system are from a minimum displacement side 
stick controller. This is the same force command side stick that is used on the production F-16. More 
information on the F-16 side stick can be found in reference 5. The longitudinal control law is a blended 
pitch rate and normal acceleration command system. Desired longitudinal motion is achieved though 
symmetric deflection of the elevons and ailerons. Lateral stick inputs are translated into a limited roll rate 
command. The maximum allowable roll rate command can be reduced by placing the stores cockpit 
switch in the CAT III position. Desired lateral motion is achieved through asymmetric deflection of the 


4 


ailerons and elevons. Leading edge flaps are used to augment lateral-directional stability at low speed 
flight conditions and to provide pitch trim and improved performance at higher speeds. 

The basic F-16XL airplane was modified by replacing the obsolete analog computers with 
quadraplex-redundant production F-16 (block 40) digital flight control computers (DFLCCs). The 
F-16XL control laws were re-coded in the digital domain with a sample time of 64 cycles/sec. Other 
changes to the control laws included the addition of new, and modification of some existing, gains and 
filters. The existing electronic component assembly (ECA) was retained, but some of the functions it 
performed, including LEF scheduling, air data, and angle of attack functions, were moved to the DFLCC. 
More detailed information about the architecture and function of the DFLCS is given in reference 6. 


MANEUVERS FLOWN 


Ten flights were flown between December 1997 and March 1998 with the new DFLCS. The objective 
of these flights was to demonstrate adequate flying qualities and define a flight envelope for the F-16XL 
DFLCS. A variety of tasks were performed at flight conditions that included a Mach number as high as 
1.6, an angle of attack as high as 18°, and altitude as high as 35,000 feet. Figure 3 shows selected test 
points used during the DFLCS program. 


O Point flown during 
DFLCS program 



.2 .4 .6 .8 1.0 1.2 1.4 1.6 1.8 2.0 2.2 


Mach number 


040044 


Figure 3. Flight envelope and limits for F-16XL ship 1. 
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Doublets in all three axes, windup turns, -1.0 g pushovers, steady heading sideslips and 360° rolls 
were performed at most flight conditions. Pitch and roll frequency sweeps were also performed at most 
flight conditions, but due to control surface rate limiting, the roll frequency sweep data is unusable. Pilot 
comments and Cooper-Harper rating (CHR) were obtained for close trail formation flight and air-to-air 
tracking maneuvers in both up-and-away (UA) and powered approach (PA) configurations. Additional 
tasks included 180° over-the-top rolls, pitch, roll and normal acceleration captures, loaded rolls, and 
loaded roll reversals. Appendix A contains detailed task descriptions and the criteria used to assess the 
performance of the airplane for selected maneuvers. 


Two new restrictions were placed on the airplane for the DFLCS program as a result of problems 
identified during piloted simulation. During testing, the simulator predicted an increase in roll rate 
of about 25 percent over the original analog system. Because sufficient instrumentation was not available 
to monitor the potential increase in structural loads, the vehicle was restricted to flying with a cockpit 
stores switch in the CAT III mode only. Engaging the CAT III switch reduces the maximum 
possible commanded roll rate by 75 deg/sec. With the CAT III switch engaged the digital control laws 
commanded less roll rate than the analog control laws. The simulation also identified a deficiency in the 
DFLCS control laws that allowed the airplane to exceed the 9.0 g limiter during aggressive maneuvering. 
The second restriction, which requires the airplane to be operated with the g-limiter set no higher than 
7.2 g, was placed on the airplane to eliminate the potential to exceed the 9.0 g limit in flight. 


PILOT QUALITATIVE ASSESSMENT 


This section provides an overview of pilot opinion of the handling qualities of the F-16XL with the 
DFLCS. The CHR and pilot comments were obtained from two pilots for several handling qualities tasks. 
A summary of the pilot ratings for the 3.0 g tracking and formation flight tasks can be found in tables 1 
and 2 respectively. A more detailed listing of the pilot ratings and comments is given in Appendix B. 


Table 1. Pilot ratings given during formation flight tasks. 


Altitude, ft 

Mach number 

Steady state 

Reversal 

10000 

0.8 

4 

7 

10000 

0.9 

4 

6 

15000 

0.6 

5 

7 

15000 

0.9 

4 

7 

25000 

0.6 

4 

5 or 6 
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Table 2. Pilot ratings given during air-to-air tracking tasks. 


Altitude, 

ft 

Mach 

number 

Velocity, 

ft/sec 

Dynamic pressure, 
psi 

Gross 

acquisition 

Fine 

tracking 

10000 

0.80 

449 

653 

4 

7 

10000 

0.90 

507 

826 

3 

7 

15000 

0.60 

304 

301 

6 

7 

15000 

0.50 

250 

206 

3 

4 

15000 

0.69 

350 

395 

2 

3 

15000 

0.78 

400 

510 

3 

4 

15000 

0.90 

465 

678 

4 

7 

25000 

0.95 

407 

496 

3 

not given 

25000 

0.90 

384 

446 

3 

4 

25000 

0.60 

248 

198 

not given 
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In general, pilots gave favorable comments for the aircraft performance in the lateral axis during 
handling qualities maneuvers. Pilots also noted that the airplane with the DFLCS was “very similar to the 
analog aircraft.” Performance during lateral handling qualities tasks was typically rated as desired. 
Steady state performance during formation flight tasks was rated as adequate and given primarily level 2 
CHR. Pilots also commented that adequate performance was not possible while executing reversals 
during formation flight tasks and typically gave level 3 CHR. During air-to-air tracking tasks, the 
airplane was given primarily level 2 ratings for gross acquisition and level 2 to level 3 ratings for fine 
tracking. Frequent references were made to a “pitch bobble.” This pitch bobble seemed to have the most 
negative effect during fine tracking, and was the main contributor to the “less than adequate” 
performance (level 3) ratings given by pilots at some flight conditions. 

FLIGHT DATA ANALYSIS 

Conventional handling qualities analysis techniques were applied to the F-16XL flight data. These 
techniques are generally empirical in nature and were developed using aircraft that utilized more 
conventional control stick dynamics. No corrections to the criteria are available to take into account the 
F-16XL side stick. 


ROLL PERFORMANCE 

Full stick, 360° rolls were performed at various altitudes and Mach numbers with the cockpit switch 
set to the CAT III configuration. From each of these rolls the maximum roll rate, roll mode time constant, 
effective time delay, and the time taken to reach a 90° bank angle were obtained. Results were compared 
with the criteria found in reference 7. 
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Roll Mode Time Constant 


The roll mode time constant (x ) and effective time delay (x ) were found using the time history 
method show in figure 4. In this method, t| is defined as the time when the lateral stick input reaches 
50 percent of maximum value. A line representing the maximum slope of the roll rate is plotted; the time 
at which this line intersects the x-axis is denoted as t 2 . The roll rate reaches 63 percent of its maximum 
value at t 3 . The x is the time difference between t 2 and tj. The x r is the difference between t 2 and t 3 . 



Figure 4. Time history method for x f and x gff calculation. 


This method was validated using the model shown in figure 5. Full stick, 360° rolls from flight data 
were analyzed using the above method and the resulting x r and x gff values were substituted into the 
model. Lateral stick measurements from flight data were used as input to the model. The model output 
and flight data roll rate were compared. A sample comparison is shown as figure 6. Although the flight 
data shows a higher order roll rate response, the model accurately reproduces the initial delay and roll rate 
onset. 
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Transfer fen 
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Figure 5. Model used for x r and x eff time history method validation. 
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Figure 6. Sample result of comparison between model and F-16XL flight data. 
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The roll mode time constants and effective time delays for the F-16XL with the DFLCS are shown in 
figure 7. The x f varied from 0.21 to 0.61. These values are predicted to produce level 1 handling 
qualities. The x gff was approximately 0.15 and predicts level 2 handling qualities. 

Figure 8 shows a plot of the x versus x f (ref. 7). Most of the F-16XL data is in the level 3 region, 
due to low roll mode time constants and high time delays. As pilot comments indicate desirable 
performance in the lateral axis, this may indicate that the time delay boundaries are too restrictive. 
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Figure 7. Roll mode time constant and effective time delay as a function of flight condition. 
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Figure 8. Roll mode time constant as a function of time delay. 
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Maximum Roll Rate and Time to Reach a 90° Bank Angle 


Figure 9 shows the maximum roll rate achieved by the DFLCS in the CAT III configuration during 
full stick rolls. Flying the airplane in conventional mode could increase the maximum roll rate by 
75 deg/sec. The time to reach a 90° bank angle was measured and is plotted in figure 10 against the 
criteria found in reference 7. These results show a combination of level 1 and level 2 handling qualities, 
depending on flight conditions. 
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Figure 9. Maximum roll rate versus velocity. 
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Figure 10. Time to roll to 90 bank angle as a function of velocity. 


LONGITUDINAL RESULTS 


Fast Fourier Transform Analysis 


Many of the analysis methods presented in the “Longitudinal Results” section require aircraft 
frequency response data. This data was obtained from 30-sec pitch frequency sweeps performed by pilots 
at flight conditions throughout the F-16XL flight envelope. A fast Fourier transform (FFT) technique was 
used on this time history data to obtain either pitch rate to stick input transfer functions or pitch attitude to 
stick input transfer functions. The FFT used stick force in lb as input, and pitch rate in deg/sec or pitch 
attitude in deg as output. To avoid nonlinearities, the stick input measurement was taken after the stick 
shaping function. Figure 11 shows typical stick input, pitch rate, and pitch attitude time histories. Typical 
pitch rate to stick input and pitch attitude to stick input transfer functions are shown in figure 12 and 
figure 13 respectively. 
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Figure 11. Typical frequency sweep time history. 
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Figure 12. Typical pitch rate to stick transfer function obtained from F-16XL flight data. 
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Figure 13. Sample pitch attitude to stick input transfer function from F-16XL flight data. 


Flight data frequency sweeps were performed with the airplane trimmed for 1.0 g flight; however, 
results were typically compared with the pilot ratings and comments from 3.0 g tracking tasks. To justify 
the direct comparison between the two, some transfer functions from a 1.0 g flight condition were 
compared with those from a 3.0 g flight condition. As no frequency sweeps were performed at 3.0 g in 
flight, simulation data was used for this comparison. Pitch frequency sweeps were performed in the 
simulation for 1.0 g flight and repeated with the vehicle trimmed in a 3.0 g turn. Pitch rate transfer 
functions were obtained for both time histories. These transfer functions were nearly identical, as shown 
by the representative plot in figure 14. 
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Figure 14. Pitch stick to pitch rate transfer function comparison for frequency sweeps at 1.0 g and 3.0 g. 


Lower Order Equivalent System 

The lower order equivalent system (LOES) is a frequency response method used to reduce complex, 
higher order models of aircraft dynamics to a lower order form suitable for direct comparison with 
conventional flying qualities criteria. The LOES method was applied to F-16XL flight data for pitch rate 
to stick input transfer functions obtained from pilot initiated pitch frequency sweeps. Results were 
compared with the flying qualities criteria given in reference 7. 
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Method 


Pitch rate transfer functions were fit to a second order system of the form: 


q(s) _ Kg (s + L a )e ^ 
depO) 5 2 + 2 ^ e to e + C0g 

by minimizing the following cost equation: 

Cost = (Gainpj ight -Gain L oEs) 2 + 0.0175(Phasep|igi lt -Phase L oEs) 2 (2) 

For this analysis, the dimensional lift curve slope (L a ) was held constant at a value estimated from 
flight data using: 


L 


a 


N z^ 
a (rad) 


x 



V, 


TRUE 



(3) 


N, 

The parameter, — was calculated as the average slope of the N _ versus a curve for the low 
oc 

frequency segment of the frequency sweep, as shown in figure 15. V TRUE was taken to be the true 
airspeed of the vehicle at the start of the frequency sweep. 
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Figure 15. L a estimation method. 


In general, LOES fits were performed on flight data over the range from 0.2 to 10 rad/sec. For some 
flight conditions, this frequency range was reduced because of poor coherence of the data. A typical 
LOES fit to a flight data pitch rate transfer function is shown in figure 16. 
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Figure 16. Typical LOES fit to flight data pitch rate transfer function. 


Results 


LOES fits were attempted for each flight condition in which frequency sweep data was available. 
Some results, however, were discarded due to poor matches with flight data. Where acceptable fits could 
be obtained, the equivalent time delay, short period frequency, and short period damping were taken from 
the LOES model. Table 3 summarizes these results. 


Table 3. Longitudinal LOES results. 


Llight 

condition 

Altitude, 

ft 

Mach 

number 

Normal load 
per a, 
g / rad 

Equivalent 

frequency, 

rad/sec 

Equivalent 

damping 

Equivalent 
time delay, 
sec 

Dimensional 
lift curve slope, 
l/sec _1 

1 

10,000 

0.81 

30.30 

2.81 

1.35 

0.18 

1.16 

2 

15,000 

0.47 

9.98 

1.52 

1.25 

0.19 

0.65 

3 

15,000 

0.60 

14.51 

1.36 

1.36 

0.18 

0.77 

4 

15,000 

0.60 

12.91 

1.54 

1.34 

0.18 

0.67 

5 

15,000 

0.70 

18.74 

1.73 

1.70 

0.18 

0.83 

6 

15,000 

0.78 

24.16 

2.48 

1.78 

0.18 

0.95 

7 

20,000 

0.60 

10.64 

1.10 

1.72 

0.17 

0.55 

8 

25,000 

0.60 

10.15 

0.97 

1.54 

0.19 

0.54 

9 

25,000 

0.80 

12.85 

1.34 

1.46 

0.18 

0.51 
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Time delays ranged from 0.17 to 0.21 sec. As shown in figure 17, when compared with the handling 
qualities boundaries found in reference 7, these results are level 2. Damping values were between 1.20 
and 2.03 and are also primarily level 2, also shown in figure 17. Estimated short period frequencies 
ranged from 0.97 to 2.85 rad/sec and typically increased with increasing q . These short period 
frequencies predict level 2 to level 3 handling qualities when compared with the criteria found in 
reference 7, as shown in figure 18. Generally, these predictions are consistent with the level 2 to level 3 
pilot rating given during the close trail formation flight and air-to-air tracking maneuvers. Based on the 
LOES short period frequency estimates, the data also predict an improvement in handling qualities as 
airplane speed increases. This trend was not seen in the actual pilot ratings or comments. 
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Figure 17. LOES results: equivalent time delay as a function of flight condition. 



Figure 18. LOES short period frequency estimates for the F-16XL. 
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Neal-Smith Criterion 


The Neal-Smith criterion (ref. 8) is a method for estimating the handing qualities of fighter aircraft. 
This method was applied to F-16XL flight data for pitch attitude to stick input transfer functions obtained 
from pilot initiated pitch frequency sweeps. 


Method 


The Neal-Smith method (ref. 8) adds a pilot modeled as a simple compensator to the aircraft pitch 
attitude control loop, as shown in figure 19. 


Pilot/compensator 


Desired 

pitch 

attitude 


A v 

K p e _0 - 3s 

T p i S +1 


F s 

F-16XL 
aircraft plus 
control system 


J > 

A 

Xp2 S + 1 










Aircraft 

pitch 

attitude 


040060 


Figure 19: Block diagram of the pitch attitude control loop used in Neal-Smith analysis. 


Compensator parameters are set to force the closed loop pilot/aircraft system to meet the following 
requirements: 

• -90° phase at the bandwidth frequency. 

• A minimum droop of -3 dB at or below the bandwidth frequency. 

Once the compensator parameters are set, the maximum value of the compensated closed loop 
magnitude curve (above the bandwidth frequency) is found. This value is known as the resonance peak 
and is used as measure of pilot induced oscillation (PIO) tendency. The amount of pilot-compensator 
lead or lag required to meet the criterion is combined with the resonance peak value to determine a 
handling qualities level. Figure 20 shows the Neal-Smith level boundaries with typical pilot comments 
for each region of the chart. 

The Neal-Smith method uses a bandwidth frequency to set the difficulty level of the task being 
performed. For the F-16XL flight data, the bandwidth frequency used during analysis was 3 rad/sec. 
The pilot time delay was 0.3 sec. 
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-40 -30 -20 -10 0 10 20 30 40 50 60 70 80 90 

Lead compensation, deg 


Level 

Region 

Pilot comments 

1 

A 

Good responsive aircraft. Easy to acquire target. 

2 

B 

Initial responses abrupt. Tendency to bobble on target. Have to fly it smoothly. 
Initial forces light, heavying up as response develops. 

2 

C 

Tendency to oscillate or overshoot. 

2 

D 

Initial response sluggish. Final response difficult to predict. Tendency to 
overcontrol or dig in. Have to overdrive it. Initial forces heavy, lightening 
up as response develops. 

3 

E 

Abrupt response. Strong pilot induced oscillation tendencies. Have to fly it 
smoothly. 

3 

F 

Strong pilot induced oscillation tendencies. 

3 

G 

Sluggish response. Strong pilot induced oscillation tendencies. Have to 
overdrive it. 

040061 


Figure 20. Explanation of the Neal-Smith chart. 


Results 

The Neal-Smith method was applied to the F-16XL pitch attitude to stick input transfer functions. 
For most flight conditions, the flight data frequency range analyzed was 0.2 to 10 rad/sec. This range was 
reduced for some flight conditions due to poor coherence of the flight data. Figure 21 shows an example 
of the compensated closed loop response obtained using the Neal-Smith method. 
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Figure 21. Compensated closed loop frequency response obtained using Neal-Smith method. 


Table 4 summarizes the Neal-Smith handling qualities predictions for the F-16XL. The majority of 
the results were level 2, and fall into the region D area of the Neal-Smith chart, as shown in figure 22. 
Required pilot lead values ranged from 23 deg (supersonic) to 76 deg at the lowest q condition. These 
results show an improvement in airplane handling qualities as speed increases. While this is consistent 
with the LOES results, this trend was not seen in the actual pilot ratings or comments. Neal-Smith 
analysis predicted level 1 handling qualities for most supersonic flight conditions. Unfortunately, no 
tracking or formation flight tasks were performed at supersonic flight conditions; therefore, there are no 
pilot opinions with which to compare these results. Although Neal-Smith predicts level 2 results, which 
is consistent with the rating given by pilots during the formation flight and air-to-air tracking maneuvers, 
the majority of the data fall into the region where excessive lead is required. These characteristics were 
not observed in the pilot comments, which indicated a consistent problem with pitch bobble. 



Lead compensation, deg 
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Figure 22. Neal-Smith results for the F-16XL. 


Table 4. Results from Neal-Smith analysis. 


Mach 

number 

Altitude, 

ft 

Lead, 

deg 

Peak, 

dB 

0.81 

10,000 

39.24 

2.01 

0.92 

10,000 

51.84 

2.21 

0.93 

10,000 

44.83 

2.09 

0.46 

15,000 

76.89 

5.43 

0.47 

15,000 

62.55 

1.92 

0.58 

15,000 

73.36 

4.99 

0.59 

15,000 

74.61 

3.27 

0.65 

15,000 

46.69 

1.94 

0.65 

15,000 

59.48 

3.48 

0.69 

15,000 

41.42 

1.49 

0.69 

15,000 

63.21 

1.99 

0.92 

15,000 

39.85 

2.02 

0.60 

20,000 

70.00 

2.00 

0.80 

25,000 

60.59 

1.97 

0.91 

25,000 

34.26 

4.01 

1.20 

30,000 

31.89 

1.97 

1.11 

35,000 

27.41 

1.90 

1.34 

35,000 

29.11 

1.94 

1.61 

35,000 

23.44 

3.98 
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The Ralph-Smith Criterion 


The Ralph-Smith criterion estimates an average pilot CHR from the aircraft pitch attitude to stick 
force transfer function. This method was applied to the F-16XL flight data for all flight conditions where 
frequency sweep data was available. 

Method 

The Ralph-Smith method for estimating average pilot CHR is shown in figure 23. This method 
determines the slope ( S ) of the pitch attitude to stick force transfer function between one and six rad/sec 
in dB per octave. This slope is then used to determine the critical frequency (<D C ): 

0) c =6 + 0.245 (4) 

Finally, the phase angle at the critical frequency ((|) ) is found. This phase angle correlates with an 
average CHR. 
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Figure 23. Ralph-Smith method for a sample flight data transfer function. 


Results 

This method was applied to F-16XL for all flight conditions in which frequency sweep data was 
available. Results ranged from level 3 to level 1 as shown in figure 24, with ratings typically improving 
as Mach number increased. Predominantly level 1 handling qualities are predicted for supersonic flight 
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conditions. These results are consistent with the trends found in both the Neal-Smith and LOES analysis 
results. This trend, however, was not substantiated by the pilot comments and ratings received during 
handling qualities tasks. 
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Figure 24. Ralph-Smith results for the F-16XL as a function of Mach number. 

Bandwidth Criterion 

The bandwidth criterion is a frequency response method used to predict aircraft handling qualities 
during tracking tasks. This method was applied to the F-16XF flight data for pitch attitude to stick input 
transfer functions obtained from pilot initiated pitch frequency sweeps. 

Method 

For this criterion, bandwidth is defined as the maximum frequency at which a pilot can aggressively 
perform tracking maneuvers without risking instability. The bandwidth criterion calculates this frequency 
from pitch attitude to stick input transfer functions using the following process: 

Step 1: The magnitude value at the phase crossover frequency (to 180 ) is found. 

Step 2: The frequency at which the magnitude is 6 dB over the magnitude at the phase crossover 
frequency is found. This is the bandwidth frequency from the gain curve (co bo ). 
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Step 3: The bandwidth from the phase curve (co bp ) is found. This is the frequency at which a 
45° phase margin exists (phase = -135°). 

Step 4: The bandwidth frequency is determined as the smaller of co b(T and co bp . 

This method of finding the bandwidth frequency is shown in figure 25. 



®bg ^iso 


Phase, 

deg 



Figure 25. Pitch attitude to stick input transfer function showing bandwidth calculation method. 


The bandwidth frequency is combined with a time delay estimate to determine a handling qualities 
level. This time delay estimate is calculated from: 


t _ -^2co 180 + 18 0 
57.3 x 2co 18 o 


(5) 


where 2co 180 is twice the phase crossover frequency, and (J> 9[0 is the phase value at twice the phase 
crossover frequency. The excessive delay indicated by the bandwidth criterion could be a contributor to 
the pitch bobble observed in pilot comment data. 
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Results 


The bandwidth method was applied to the F-16XL for all flight conditions in which frequency sweep 
data was available. For some flight conditions, however, the transfer function showed poor coherence 
around the estimated bandwidth frequency, or near the frequency used to estimate time delay. Results for 
these flight conditions are not presented. 

Bandwidth frequencies ranged from 1.6 to 3.6 rad/sec. Time delays ranged from about 0.13 to 
0.16 ms. These results are a combination of levels 2 and 3, as shown in figure 26. In general, both 
bandwidth frequency and estimated time delays increased with increasing q . The bandwidth method 
predicts no improvement in airplane performance with increasing speed. Results show the airplane 
performance would be consistently near the level 2 to level 3 handling qualities border, regardless of 
flight conditions. These results are consistent with pilot ratings. 
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Figure 26. F-16XL bandwidth results with MIL-STD requirements, category A. 
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CONCLUDING REMARKS 


The digital flight control system (DFLCS) flight envelope clearance program began in December 
1997 and ended in March 1998. A total of ten flights were flown to collect maneuvering performance and 
handling qualities data. The flight envelope cleared to Mach 1.6 and an altitude of 40,000 ft with standard 
flight limits or Mach 1.8 and an altitude of 40,000 ft with restricted flight limits. Due to problems 
identified during piloted simulation studies, the vehicle was restricted to flying with a cockpit stores 
switch in the CAT III mode only and with the g-limiter set no higher than 7.2 g. 

Pilot comments and Cooper-Harper ratings (CHR) were obtained for air-to-air tracking and close 
trail formation flight tasks at several subsonic flight conditions. Pilot comments during lateral handling 
qualities tasks were generally favorable. Frequent references, however, were made to a pitch bobble 
during longitudinal tasks. This pitch bobble degraded airplane performance during fine tracking and 
caused the pilots to give level 3 ratings at some flight conditions. Pilots also noted that adequate 
performance could not be obtained for reversals during close trail formation flight, and rated the airplane 
as level 3 for these tasks at some flight conditions. 

Pitch and roll frequency sweep data was obtained at both subsonic and supersonic flight conditions. 
However, due to control surface rate limiting, the roll frequency sweep data was unusable. Conventional 
analysis techniques were applied to longitudinal frequency sweep data obtained during flight. Data 
analysis predicts level 2 to level 3 handling qualities, depending on flight conditions. 

The Neal-Smith, Ralph-Smith, and lower order equivalent system (LOES) analysis methods 
predicted an improvement in handling qualities as airplane speed increases. This trend was not apparent 
in the actual pilot rating and comments. Both Neal-Smith and Ralph-Smith criterion predicted level 1 
handling qualities for supersonic flight conditions. No pilot ratings were obtained at supersonic flight 
conditions; these results could not be verified. Bandwidth results showed the airplane near the level 2 to 
level 3 handling qualities border regardless of flight conditions. These results were largely due to the high 
estimated time delay of the F-16XL with the DFLCS. 

The analysis techniques applied to F-16XL frequency sweep data were developed using more 
conventional stick dynamics, and no corrections were made to account for the F-16XL side stick force 
controller. This may explain some of the discrepancies between analysis results and actual pilot ratings 
and comments. 


Dryden Flight Research Center 
National Aeronautics and Space Administration 
Edwards, California 
January 23, 2004 
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APPENDIX A 


DESCRIPTION OF HANDLING QUALITIES TASKS 
Normal Acceleration Captures 

From 1.0 g trim conditions, the pilot performed an abrupt symmetric pull up to capture 2.0 g. Pilots 
also performed 3.0 g captures starting from 2.0 g windup turns. Pilots commented on the initial and final 
aircraft response, pitch and roll attitude performances, and stick forces using abrupt inputs. 

Pitch Attitude Captures 

From 1.0 g trim conditions, pilots captured 5° changes in pitch attitude using abrupt stick inputs. 
Pitch attitude captures were also performed using 2.0 g windup turns as the starting point. Pilots 
commented on the initial and final aircraft response and stick forces using abrupt inputs. 

Bank Angle Captures 

From 1.0 g trim conditions, the pilot captured target bank angles using full stick force. Target bank 
angles of ±30° and ±90° were captured starting from a 1.0 g trim reference point. Target bank angles of 
±90° were also captured using 90° opposite bank as the starting point of the maneuver. Pilots commented 
on the initial and final aircraft response, roll attitude performances, and stick forces using abrupt inputs. 

Air-to-Air Tracking 

In this maneuver, the F-16XL attempts to track a target airplane from ranges of 1000 to 1500 feet. 
Once the F-16XL is in a position behind the target, the target airplane performs a 3.0 g turn. When the 
target airplane is about 30° off the nose, the F-16XL pilot acquires the target. With the target acquired, 
the F-16XL fine tracks the target for 2 to 3 seconds. The F-16XL then calls for target reversal with a 
repeat in the opposite direction. This task is repeated with random maneuvering of the target up to 3-0 g 
with unannounced reversals. 

To achieve desired performance in gross acquisition, the pilot must be able to track the target within a 
50 mm diameter on the pipper, with one overshoot and no PIO. Adequate performance required that the 
target be kept within 75 mm with two overshoots and no PIO. In fine tracking, desired performance kept 
the target within a ±10 mil diameter on the pipper for 2 sec without PIO. Adequate performance required 
±20 mil without PIO. 

Pilots commented on undesirable motions, predictability, aggressiveness effects and compensation 
techniques. Figure A-l shows the CHR scale, which was used to rate both gross acquisition and fine 
tracking based on the desired and adequate performance margins. 
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Adequacy for selected 
task or required operation* 


Aircraft 

Demands on the pilot in selected 

characteristics 

task or required operation* 

Excellent 

Pilot compensation not a factor 

Highly desirable 

for desired performance 

Good 

Pilot compensation not a factor 

Negligible deficiencies 

for desired performance 

Fair - some mildly 

Minimal pilot compensation 

unpleasant deficiencies 

required for desired performance 


Pilot 


Yes 



Is it 

satisfactory without 
improvement? 





Minor but annoying 
deficiencies 

Desired performance requires 
moderate pilot compensation 

Deficiencies 

warrant 

improvement 


Moderately objectionable 
deficiencies 

Adequate performance requires 
considerable pilot compensation 



Very objectionable but 
tolerable deficiencies 

Adequate performance requires 
extensive pilot compensation 


Yes 


Is adequate 
''performance attainable 
with a tolerable pilot 
workload? 


Yes 



Deficiencies 

require 

improvement 


Major deficiencies 

Adequate performance not 
attainable with maximum tolerable 
pilot compensation. Controllability 
not in question 

Major deficiencies 

Considerable pilot compensation 
is required to control 

Major deficiencies 

Intense pilot compensation is 
required to retain control 



Is it 
controllable? 


No 



Improvement 

mandatory 


Major deficiencies 


Control will be lost during some 
portion of required operation 


Definition of required operation involves designation of flight 
phase and/or subphases with accompanying conditions. 


Pilot decisions 


Figure A-l. Cooper-FIarper rating scale. 


Close Trail Formation Flight 

In this maneuver, the F-16XL follows the tail of the lead airplane with increasing aggressiveness 
though s-tum maneuvers. For initial evaluation, the lead airplane maneuvered up to 3.0 g. Desired 
performance required that both lateral and vertical displacement be kept within ±1 tailpipe diameter 
from the tailpipe without PIO. Adequate performance allowed for lateral and vertical displacements of 
±2 tailpipe diameters without PIO. 

Pilots evaluated response during steady state flight and during reversals. Cooper-Harper ratings were 
given for both gross acquisition and fine tracking based on the desired and adequate performance 
margins. 
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APPENDIX B 


PILOT COMMENTS AND RATINGS FOR HANDLING QUALITIES TASKS 

This appendix presents pilot comments and CHR for handling qualities tasks flown with the F-16XL 
during the DFLCS program. Some of the comments contained herein have been edited. 

Tasks performed include normal acceleration captures, pitch attitude captures, bank angle captures, 
air-to-air tracking, and close trail formation flight. Appendix A contains detailed descriptions of these 
tasks; the criteria used to assess performance for air-to-air tracking and close trail formation flight tasks 
are also included in Appendix A. 


Normal Acceleration Captures 

Flight Condition: Mach 0.6, 25K 

2.0 g capture from wings level: 

“Full abrupt stick input. Easy to capture. Bobbled to 1.7 g. Predictable.” 

3.0 g capture from 2.0 g windup turn: 

“Got right to 3 g with full aft stick. Easy to capture. Starting to bleed off — really can’t get much more 
than that.” 

Flight Condition: Mach 0.9, 25K 

2.0 g capture from wings level: 

“Expected faster initial acceleration at higher speed. Was still relatively easy to capture. I did spike it 
down to about 1.6 g, then recaptured the 2 g pretty well.” 

3.0 g capture from 2.0 g windup turn: 

“Spiked to 3.5 g. Eased off to capture 3 g. Good, predictable response.” 

Pitch Attitude Captures 

Flight Condition: Mach 0.6, 25K 

5° pitch attitude capture from wings level: 

“Trying to use abrupt inputs to really capture it. Three degree overshoot and a little bit of bobble as I 
settled in on it.” 

5° pitch attitude capture from constant altitude 2.0 g windup turn: 

“Moved right to 5° with full aft stick. Very easy to capture. Got about all you’re going to get.” 
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Flight Condition: Mach 0.9, 25K 

5° pitch attitude capture from wings level: 

“Negligible overshoot. Three quick half-degree bobbles. Predictable and good.” 

5° pitch attitude capture from constant altitude 2.0 g windup turn: 

“Using gyro in cockpit. Can’t use HUD. Response seems a bit quicker — maybe due to differences in 
gauges. Predictable.” 

Bank Angle Captures 

Flight Condition: Mach 0.6, 15K 

30° bank angle captures from wings level: 

“Nice response. Ten degree overshoot. Very easy.” 

90° bank angle captures from wings level: 

“Moderate roll mode time constant. Builds up gradually.” 

Flight Condition: Mach 0.9, 15K 

30° bank angle captures from wings level: 

“Much more abrupt roll response. On left capture, went to 40°, came back with another overshoot to 
35°, then captured it nicely. Better on right — did not overshoot. Crisp roll response.” 

90° bank angle captures from wings level: 

“A little bit of bobble. Two small amplitude bobbles. Seems like a nice smooth response. Easy to 
capture.” 

Flight Condition: Mach 0.6, 25K 

30° bank angle captures from wings level: 

“One overshoot of about three degrees on left capture. Pretty easy to capture. Nice crisp, quick 
movement — easier than the simulator. Bigger overshoot on left capture — probably 10 to 12°, but came 
back with no overshoot to capture. A good crisp acceleration.” 

90° bank angle captures from wings level: 

“Nice acceleration. Easy to check with negligible overshoot. Kind of a smooth roll rate. Easy to 
capture.” 
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Flight Condition: Mach 0.8, 25K 


90° bank angle captures from wings level: 

“Moderate roll rate. Easy to anticipate. Easy to lead. Minimum compensation.” 

90° bank angle captures from 90° opposite bank: 

“Fifteen degree overshoot on right capture. Performance right on limit of desired. Increased 
workload.” 

Flight Condition: Mach 0.9, 25K 

30° bank angle captures from wings level: 

“Nice acceleration. Spiked to just under 45° on left capture, then came back to 30° with no problems. 
Nice forces. Ten degree overshoot on right capture. Came back with a one to two degree overshoot then 
captured. Nice crisp response.” 

90° bank angle captures from wings level: 

“Slight ratcheting. Not quite as fast as expected. Starts off well, but steady state is slower than 
expected. Stuck around 70° then captured.” 

Flight Condition: 18° a, 30K 

90° bank angle captures from wings level: 

“Right — coupled with pitch. Adequate. A couple of oscillations. Slow roll rate. 

Left — smooth and predictable — captured real well.” 

90° bank angle captures from 90° opposite bank: 

“Desired performance. No problems with pitch. Easy to anticipate.” 

Air-to-Air Tracking 

Flight Condition: Mach 0.8, 10K 

“Desired performance on gross acquisition — nice response. Fine tracking not quite adequate. Pitch 
bobble — 8 mils.” 

CHR: gross acquisition — 4; fine tracking — 7. 
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Flight Condition: Mach 0.9, 10K 


“Could get desired on gross acquisition — nice handling qualities. Couldn’t get adequate in fine 
tracking.” 

CHR: gross acquisition — 3; fine tracking — 7. 

Flight Condition: Mach 0.6, 15K 

“No PIO tendency. Twenty mils edge twice during gross acquisition. Adequate performance not 
possible for fine tracking. Slight pitch bobble. No major deficiencies.” 

CHR: gross acquisition — 6; fine tracking — 7. 

Flight Condition: Mach 0.9, 15K 

“Nice crisp performance on gross acquisition. Able to get it there without any overshoots. Desired. 
Right at ten mils or so. Real nice handling qualities for gross acquisition. Not quite adequate performance 
on fine tracking.” 

CHR: gross acquisition — 4; fine tracking — 7. 

Flight Condition: Mach 0.6, 25K 

“Three g tracking task not doable at this flight condition. With full afterburner and full aft stick, it is 
just lagging. Can’t match target’s pitch rate. At 45° and full aft stick, can’t match target’s turn rate. Just 
continues to bleed. Have to go off the plane and cut across, and still can’t get the nose back to him.” 

“Two g tracking — two overshoots on gross acquisition. Once to edge, once a couple of mils past. Not 
able to get adequate performance during fine tracking. Transitory, two to four mils off target. Cycles 
around target. No real PIO tendency.” 

CHR: gross acquisition — none given; fine tracking — 6 or 7. 

Flight Condition: Mach 0.9, 25K 

“Crisper response. Able to get desired performance on gross acquisition. Could not keep adequate in 
fine tracking. Would be stable on exhaust and bobble to wingtip. In a period of ten seconds, a bobble put 
it out to almost twice the adequate performance level allowance.” 

CHR: gross acquisition — 3; fine tracking — no rating. 
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Flight Condition: Mach 0.9, 25K 

“Desired performance on gross acquisition. Crisper response. Could not keep within desired for fine 
tracking. A bobble would put out to adequate performance.” 

CHR: gross acquisition — 3; fine tracking — 4 

Flight Condition: 250 KCAS, 15K 

“Easy to get desired for gross acquisition — within 15 mils. Real smooth, some pitch bobble in fine 
tracking.” 

CHR: gross acquisition — 3; fine tracking — 4. 

Flight Condition: 280 KCAS, 15K 

“PIO tendency in pitch axis. Similar to analog airplane — maybe better. Pitch bobble (four mils). Nice 
and stable.” 

CHR: none given. 

Flight Condition: 350 KCAS, 15K 

“Easy, nice handling qualities, no overshoot in gross acquisition. Preferred speed range for fine 
tracking.” 

CHR: gross acquisition — 2; fine tracking — 3. 

Flight Condition: 400 KCAS, 15K 

“Easy gross acquisition. Within 30 mils without overshoot. Most pitch bobble during fine tracking at 
this speed range. Seemed to decrease at other speeds.” 

CHR: gross acquisition — 3; fine tracking — 4. 

Flight Condition: 11° a, 15K, Powered Approach 

“Easy to get desired for gross acquisition. Some pitch bobble seen in fine tracking; no roll bobble. 
More pitch bobble with increased aggressiveness. 

CHR: gross acquisition — 2; fine tracking — 3. 

“Two overshoots in gross acquisition. Sensitive. Pitch heavier than roll. Energy low. Tendency to 
couple in roll — impacts predictability.” 

CHR: gross acquisition — 5; fine tracking — 3. 
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“Nose seems to bobble. Pitch bobble — 5 mils.” 


CHR: gross acquisition — 3; fine tracking — 3. 

Close Trail Formation Flight 
Flight Condition: Mach 0.8, 10K 

“Desired performance in steady state. Very nice handling qualities. Need to lag for quicker reverse. 
For slower reverse, can get adequate performance, but not desired.” 

CHR: steady state — 4; reversals — 6. 

Flight Condition: Mach 0.9, 10K 

No comments. 

CHR: steady state — 4; reversals — 7. 

Flight Condition: Mach 0.6, 15K 

“Able to maintain adequate performance steady state. Adequate performance not possible for 
reversals.” 

CHR: steady state — 5; reversals — 7. 

Flight Condition: Mach 0.9, 15K 

“Able to maintain desired performance for the majority of the time in steady state. For a number of 
seconds after a reversal, unable to maintain adequate. Probably five or more diameters away.” 

CHR: steady state — 4; reversals — 7. 

Flight Condition: Mach 0.6, 25K 

“Can get desired performance in steady state for both longitudinal and lateral-directional. Any 
movement puts me to adequate, or not even adequate, even if he is calling the reversals. We can’t match 
the P s , so we start drifting back. Difficult to evaluate at greater ranges.” 

CHR: steady state — 4; reversals — 5 or 6. 
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Flight Condition: Mach 0.9, 25K 


“Noticed a couple of PIO bobbles that were outside of adequate then got settled out. Not the most 
predictable thing. Could have mainly desired for an extended period of time, then have adequate, or not 
even adequate performance for straight and level flight. Relatively predictable and able to meet adequate 
the majority of the time in turns.” 

CHR: none given. 

Flight Condition: 280 KCAS, 15K 

“Control harmony good. Can see difference between pitch and roll. Adequate. Very similar to analog 
aircraft. No tendency roll-ratchet. Six to seven mil cycling in pitch.” 

CHR: none given. 
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